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CRITERIA FOR THE EXISTENCE OF CUSPIDAL THETA 

REPRESENTATIONS 

SOLOMON FRIEDBERG AND DAVID GINZBURG 


Abstract. Theta representations appear globally as the residues of Eisenstein series on 
covers of groups; their unramified local constituents may be characterized as subquotients 
of certain principal series. A cuspidal theta representation is one which is equal to the local 
twisted theta representation at almost all places. Cuspidal theta representations are known 
to exist but only for covers of GLj, j < 3. In this paper we establish necessary conditions 
for the existence of cuspidal theta representations on the r-fold metaplectic cover of the 
general linear group of arbitrary rank. 


1. Introduction and Main Results 

Let r > 2, let E be a number field containing a full set of r-th roots of unity and let 
A denote the adeles of F. For n > 2, let GLn^^(A) denote an r-fold cover of the general 
linear group. This group is a cover of GL„(A) with fibers given by and multiplication 
defined by a certain two-cocycle a. The group GLn'^ (A) is obtained by piecing together local 
metaplectic groups GLn\Fv) over the places v oi F (the group GLn\Fu) is, however, not 
the Ey-points of an algebraic group). Following Takeda |T7], we shall use the local cocycle 
give by Banks-Levy-Sepanski pQ, which is block-compatible, and adjust it by a coboundary 
to construct a global cocycle. 

Let On^ denote the theta representation on the group GLn\A). This representation 
was defined in Kazhdan-Patterson using the residues of Eisenstein series, as follows. 
(Kazhdan and Patterson work with a different cocycle than Takeda but the groups are 
isomorphic.) Let Bn be the standard Borel subgroup of GLn, and C Bn denote the 
maximal torus of GLn- Let s be a multi-complex variable, and define the character jUg of 
Tn(A) by /is(diag(ai,..., a„)) = ]))[. |ai|®L If H is an algebraic subgroup of GLn, let H^^\Fn) 
(resp. iLh)(A)) denote the full inverse image of H{Fi,) (resp. H{A)) in GLn\Fy) (resp. 
GLn^(A)). Let Z{Tn\A)) denote the center of Tn\A). Then /ig uniquely determines a 
genuine character of Z{Tn\L^)- Choose a maximal abelian subgroup A of Tn\A), extend 
this character to a character of A, and induce it to Tn\A). Then extend trivially to Bn\A) 
using the canonical projection from Bn\A) to Ti^^(A), and further induce it to the group 
GLn\A). We write this induced representation Ind*^^ 

Bn 
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Ps- It follows from HH that this 
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construction is independent of the choice of A and of the extension of characters. Forming 
the Eisenstein series E{g,s) attached to this induced representation, it follows from [11], that 

r-f-1 

when ps = (with the modular function of Bn), this Eisenstein series has a nonzero 

residue representation. This is the representation Qn ■ 

Let u he & hnite place for F such that \r\y = 1. Dehning similar groups over the local 

held Fy, it follows from [TT] that the local induced representation Ind^(^" ^ ^ 

(r'l 

unique unramihed subquotient which we again denote by Qn. This representation is also 


the unique unramihed subrepresentation of Ind*^^" . If Xu denotes an unramihed 


character of F^, then the induced representation Ind 






Xi'^b'^ is also reducible, and 


one 


(r) 

can dehne the local twisted theta representation Qn,x„ as the unique unramihed sub- 


“ / \ 

representation. Here Xv is dehned on the group Z{Tn’{Fy)) to be the character such that 


X^((diag(a^,...,a;),C)) = CXu{ai... an). 

Returning to the global case, we have 


Definition 1. An automorphic representation vr of GLn\^) is called a theta representa¬ 
tion if for almost all places v there are unramified characters Xv such that the unramified 

(r) 

constituent of vr is equal to &n,x^ ■ If f is cuspidal, we say that f is a cuspidal theta repre¬ 
sentation. 


The interesting cases of such theta representations are when the local characters Xu are 
the unramihed characters of a global automorphic character y. We shall write Qn,x for such 
a representation. 

Examples of such representations may be constructed as follows. Suppose that x = Xi for 
some global character xi- Then one can construct theta representations 0n,x by nieans of 
residues of Eisenstein series, by [TT]. (The case y = 1 was described above.) However, these 
representations are never cuspidal. 

In Flicker [B] , a classihcation of all theta representations for the covering groups GL^f\A), 
r > 2, with c = 0 in the sense of [a is given using the trace formula. The case n = r = 2 
was also studied by Gelbart and Piatetski-Shapiro [7]. When n = r = 3, Patterson and 
Piatetski-Shapiro [TT] constructed a cuspidal theta representation Qn}x for ^my y which is 
not of the form Xi, again for the cover with c = 0. This construction applied the converse 
theorem. No other examples of such representations are known. 

The basic problem is then to understand for what values of r and n, and for what characters 
X, there exists a cuspidal theta representation Qn}x- We shall give a necessary condition for 
the existence of such a representation. However, we do not determine whether or not these 
conditions are sufficient. 

First, if r < n such cuspidal representations do not exist. This follows trivially since every 
cuspidal automorphic representation of GLn\A) must be generic, but the local unramihed 
representation 0n,xi. is not generic if r < n. Hence we may assume that r > n. Our main 
result is 
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Theorem 1. Fix a natural number r, and an automorphic character x of GLi{A). Then 
there is at most one natural number n such that there is a nonzero cuspidal theta represen¬ 
tation Moreover, if such n exists, then n divides r. If a cuspidal theta representation 

©n^x exists for some n which divides r, then x Xi for any character xi- 


For n = 2 this result follows from [6]. In [6], a character x such that X 7^ Xi is called an 
odd character for the number r. 

To establish the Theorem, we need to prove three things. First that n divides r. We 
prove this in Section [3l Second, the uniqueness property of the number n. We prove this in 
Section 01 Then in Section 0] we prove the condition on the character y. The basic tool in 
these sections is the study of Eisenstein series obtained by inducing copies of cuspidal theta 
representations, and their residues. There is a unipotent orbit attached to the automorphic 
representation generated by these residues, and we determine this. However, if any of the 
conditions of the Theorem are violated then this leads to a contradiction. For example, if 
there are two cuspidal theta representations ©m,x and ©n,x attached to the same character y 
with m < n, a suitable Eisenstein series obtained by mixing them in the inducing data has a 
residue. The Fourier coefficient of this residue attached to its unipotent orbit can be analyzed 
in two different ways, with contradictory vanishing properties. The contradictory properties 
are due to a lack of symmetry for this representation under the outer automorphism of the 
Dynkin diagram, which takes the relevant parabolic used in making the induction to its 
associated parabolic, in terms of the constant terms that it supports. 

We will establish Theorem [1] using residues of Eisenstein series, but parts of it follows 
easily if one accepts Conjecture 1.2 in Bump and Friedberg [3]. Indeed, suppose that for 
some character y, there is a cuspidal theta representation dehned on the group GlIII'\A). 
Assume that for some m < r, one can dehne a theta representation ©m)x which need not be 
cuspidal, but corresponding to the same character y. Then, assuming Conjecture 1.2 in [3], 
the following identity follows from [3], Proposition 2.1 
( 1 ) 


/ 




Ir —r 


C!x(^) Idet^l" 


Zsix^s) L^{rs 



GLmiF)\GLm{A) 


Here Oifl is a vector in the space of ©r^X) cind similarly for Om]x- Also, S' is a set of places, 
including the archimedean places, such that outside of S all data is unramihed. Finally, 
is the partial L-function interpreted as in [3], and Z 5 (y,s) is a product of local integrals 
dehned on the places in S. 

Now from the dehnition of the partial L-function, it follows that this term contributes a 
hnite product of partial zeta functions to the right-hand-side ofH Hence for suitable s the 
term L^{rs — y“^ (8) Qm,x) has a simple pole. Since the integrals involved in Zs{Xi s) are 

all Whittaker type integrals, it is not hard to prove that given any complex number s, there 
is a choice of data such that Zs{Xy -s) is not zero at s. Hence, for suitable s and suitable data, 
the right hand side of ([I]) has a simple pole. But the left hand side of ([I]) is holomorphic 
for all s since ©r^x is cuspidal. This is a contradiction, and hence for all m < r the group 
GL^^ (A) has no cuspidal theta representation associated with y. Moreover, if y = yj for 
some character yi, then for any m < r, we can consider the theta representation ©m,x as 
constructed in mi- Since the left-hand side of ([T]) still represents a holomorphic function 
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even if ©m^x is not cnspidal while the right-hand side has a pole, we once again derive a 
contradiction. Hence Xi^Xi- 

We thank Erez Lapid for helpfnl conversations. 


2. Residues of Eisenstein Series 

ir) 

Given I natnral nnmbers ni > n 2 > ... > nz > 0, let 0n/,x denote theta representations 
attached to a fixed character x- Let k = ni + ■■■ + ni, so X := {rii, n 2 ,... ,ni) is a partition 
of k. Let Pni,...,ni be the standard parabolic snbgronp of GL^ whose Levi part is 

GLni X • • • X GLni embedded diagonally 

(fi'1,5'2, • • • ,5'z)'-t diag(5(i,5(2,... ,5-/) : Qj E GLr,., 

and let denote the nnipotent radical of Pni,...,ni. 

Let s = (si,..., sz) be a mnltiple complex variable. Then one may form an Eisenstein series 
s) on the group attached to the representations (0ni,x, ''' > ©Sx) by 

a variant of standard parabolic induction. Once one has a representation of the 

construction is the standard ‘averaging’ one (see, for example, Mceglin-Waldspurger [T2] . 
11.1.5); we frequently suppress the dependence of this series on the test vector used in the 
averaging from the notation for the Eisenstein series. However, since the inverse images of 
the groups GL„.(A) in do not commute, one must restrict to a smaller subgroup 

and then induce or extend from that. Let 


GL„^,o(A) = {ge GL^^(A) | det z? e (A")’'^"}. 


Then the inverse images of these groups in Mn^^...,ni{A) commute, and the group S that 
they generate is thus isomorphic to the fibered direct product of the GL^^'^. q{K) over 

Accordingly, one first restricts each representation 0n2x|bet(-)|®‘ to GL^’',^q(A), and takes 
the usual tensor product to obtain a genuine representation of S. One may then proceed to 
extend this representation to Mni,...,ni{A.), either by extending functions by zero (as in Suzuki 
[15], Section 8), by inducing to Mni^...,ni(A) (as in Brubaker and Friedberg [2], though that 
paper is written in the language of S'-integers as a substitute for the adeles), or by first 
extending to a larger subgroup of under certain hypotheses, and then inducing 

from that subgroup to Mnx...,ni(A) (as in Takeda [H]). Our main computations will take 
place in the subgroup generated by S and by nnipotent subgroups, which split via the trivial 
section u i—)■ {u, 1), hence any of these (slightly different) foundations are sufficient for the 
arguments given here. We will sometimes abuse the notation (as we already did in the case of 
induction from the Borel subgroup) and describe s) as the Eisenstein series attached 

to the induced representation 


( 2 ) 






ni,X 


IdeKOI-SeM |det(.)|“ 




As a representation, this induced space is the vector space spanned by the residues (g, s) 

as one varies over all test vectors. 

The Eisenstein series E^^}^{g,s) has a simple pole, similarly to the case Uj = 1 for all i 
which is described in Section [H Indeed, by Definition [H the unramihed constituent at a 
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place V of the representation ©nilx ^ qnotient of 

( 

This means that the nnramihed constitnent of the indnced representation (j2]) is an indnced 

iWiA — 

representation of the form Ind '' where /ig is a gennine character of the gronp 

fife {F^) 

Z{T^\Fy)) dehned as follows. Let t = diag(74i,..., Ai) where each Ai is a diagonal matrix 
in GLnXFu) which consists of r-th powers. Let i = (t,C) ^ ^{'^jf\Fp)). Then we dehne 

/*.(«)= 

i 

Argning as in [m, one sees that the Eisenstein series has a simple pole at the 

r+1 

point /is = 5^^ . 

We remark that the existence of this pole does not depend on whether some of the repre¬ 
sentations Qnlx ai'e cnspidal or not. A similar constrnction with all of the representations 
being cnspidal was studied by Suzuki [15], Sections 8 and 9. In that reference, the author 
also assumes that the Shimura lifts of the cuspidal representations in question are also cus¬ 
pidal. In our case this does not happen, but the argument about the existence of the pole is 
the same. 

Let xx residue representation of the above Eisenstein series at the above 

(r) 

point. Then the construction of the representation G^ x-^ is inductive in the following sense. 

For 1 < j < Het \j be a partition of rij. Form the representations Then we can form 

the Eisenstein series attached to the representations iVs^ni Xi x '^^^^2 \2 x’’''' ^'^^^^n!\ix) 
where r/s is an nnramihed character of Pni,...,nr We shall denote this Eisenstein series by 

®)- above, and also as in Section [T] we deduce that this Eisenstein 

r-j-l 

series has a simple pole at rjs = , and the representation generated by the residues is 


FA 


X 


1 r+1 

r ^ 2r 
U G TD 

-On™' • 


where x = UuXv 


3. The Divisibility Condition 

Suppose that &n}x is a cuspidal theta representation dehned on GLn^ (A) and that n does 
not divide r. We shall derive a contradiction. First, we construct the residue representation 
^nixx where I is a natural number and A = (n^). For convenience we sometimes 

omit A from the notation, writing C^nix instead of C^nixx' Thus Cn}x = ©i^x- 

In general, if (p is an automorphic function on a group H{A) and U is any unipotent 
subgroup of H, we write (p^ for the constant term of (p along U 

pP {h) = j p}{uh)du. 

U{F)\U(K) 

Also, if 'Xu is a character of U{F)\U{A), we write 

J p>{uh)Xu{u) du. 

U(F)\U{K) 
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We shall be concerned with the case that U = U{i_rn)n,mni the unipotent radical of the 
maximal parabolic subgroup of GLni whose Levi part is GL(i_m)n x GL^n, with 1 < m < /. 
We start with the following 


Proposition 1. Fixm, 1 <m <1, let P = P(l-m)n,mn and U = U(i_rn)n,mn- 
(i) Let Fni\ ® function in the space of Then there are functions 

space of X Tmn,x i'a the space of Cmn,x such that 


( 3 ) iTnlxfitiVl,V2)) = 5^^ it)^\l_m)n,x^'^l) 

for all unipotent elements vi G GL{i_rn)n{^) and V 2 G GLmn{^) and all t which are r-th 
powers and in the center of the Levi subgroup of P. 

(a) Fori = 1,2, let 'ipVi be characters of Vi{F)\Vi{K). Then the integral 


iTnlx)^iivi, V 2 )) f’Viivi) 'ipV2{v2) dvi dV2 


Vi(F)\Vi(A) V2(F)\V2(A) 

is zero for all Tnix space of if {Tmn,x)^‘^’^^'^ 'Is zero for all 

functions Tg-rn)n,x '^(I-m)n,x Tmn,x SpUCC of C^fl,x- 

When r = 1 and QnJx is a cuspidal representation of GL„(A), a similar statement is given 
in Offen-Sayag [13], Lemma 2.4 and Jiang-Liu [10], Lemma 4.2. 


Proof. The proof is based on a standard argument using unfolding of the Eisenstein series, 
and closely follows [I3], [lO], and [12] 11.1.7. We sketch it briefly. Let Elfi^^{g,s) denote the 
Eisenstein series attached to the induced representation 


mn,{l — m)n ' 




mn,x 


r(r) 

^{l-m)n,x 


)6p 


mn,(l — m)n 


.n,x is the residue of this Eisenstein series at s = 


Then, as explained in Section [2] above, Cn}x 
Consider the constant term {g, s) for Re(s) large. Unfolding this constant term as in 
[ncniiniEs], we obtain a sum of Eisenstein series (and degenerate Eisenstein series), where 
the sum is over Weyl elements that give a complete set of representatives for the double 
cosets Prnn,{i-m)n{F)\GLni{E)/P(i_rn)n,rnn{F)- (See for example Bump-Friedberg-Ginzburg 
[4], Eq. (1.2).) Let 


Wo = 


d(l—m)n 


Then as in the references above, for every Weyl element not equal to wo which contributes 
a nonzero term, the corresponding Eisenstein series is holomorphic at s = The contri¬ 
bution from Wo is just the intertwining operator which clearly has a simple pole at 

s = and as a function of (^ 1 ,^ 2 ) is as in ([3]). 


The claim about the dependence of (<7’i’;^^)^(^('i^iW 2 )) on t follows since Cn!x i^ ^ 
representation of the induced representation 


,(r) 


a ^ ( 

mn,(t — m)n ' 


.{rP 


mn,x 


r(r) 

^{l-m)n,x 


)d\ 


mn,(l — m)n 


at the point s = 


□ 


r—1 
2r • 


6 


We next give an application of Proposition [H 
Lemma 1. The representation square integrable. 

Proof. We use Jacquet’s criterion as stated in [12], the Lemma in 1.4.11. Note that 
consists of automorphic forms so the Lemma there is applicable. Let U denote a unipotent 
radical of a maximal parabolic subgroup P of GLni- Let U~ ^ = wUn,...,nW~^. Here w is 
the longest Weyl element in GLni- 

Suppose hrst that U is such that there is no Weyl element w of GLk such that wUw~^ C 
Up Then a standard unfolding argument implies that the constant term 

Enlx^ug.s) du 

U{F)\U{K) 

is zero for all choices of data. 

On the other hand, iiU = Ug-rn)n,mn for some m, then it follows from Proposition [1], part 

r— 1 — 1 2 ^ 

(i), that for all t in the center of P = P(i-m)n,mn we obtain the exponent Sp'^ = Sp 6p. Here 
B is the Borel subgroup of GLi^. Lemma H] follows. □ 

The above Proposition and Lemma can be extended to the general case. That is, both 
statements holds for the representation as well. 

Since we are in the case r > n, the representation Cn}x = is clearly generic. On the 

(p) 

other hand if I is chosen so that nl > r, then is not generic. Hence, there is a minimal 

natural number, which we denote by a, such that Can,x is generic, but , is not. Notice 

that since n does not divide r then an < r. Let b be the smallest natural number so that 
abn > r. 

(r) 

For the proof of the next Proposition we need to modify our construction. Let San,x 
denote an irreducible generic summand of the representation Can,x- The existence of such a 
summand follows from Lemma [T] and from the assumption that Pin,x is generic. Forming the 
Eisenstein series on GL^^i{A) attached to {San,x, ^an,x,''' ,^an,x)Vs then it follows as in the 

r+1 

previous section this series has a simple pole at the point rjs = Spf Denote the residue 
representation by SaiLx' clear from this construction that Proposition [1] holds if we 

fp) (p) 

replace the representation x with the representation 

Given an automorphic representation tt defined on a reductive group H{A), let C>(vr) be its 
set of unipotent orbits as defined in Ginzburg [8]. (For information about unipotent orbits 
see Gollingwood and McGovern [5].) A unipotent orbit O is in the set (P(vr) if hrst, vr has 
no nonzero Fourier coefficients attached to any unipotent orbit which is greater than O or 
not comparable with O and second, vr has a nonzero Fourier coefficient corresponding to the 
unipotent orbit O. Since unipotent groups split in any covering group, this dehnition extends 
without change to representations of metaplectic groups. Moreover, for the general linear 
group the unipotent orbits are parametrized by partitions, a manifestation of the Jordan 
decomposition. In our case, we have: 

Proposition 2. We have 0(8^11 J = {{an)’’). 
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Proof. This proof is similar to Jiang and Lin [TO]; see also the proof of Proposition 5.3 in 
Ginzbnrg [8]. 

We need to prove two things. First, let O = (nin 2 .. .n^) be a partition of abn. Assume 
that this partition is greater than or is not related to the partition {{an)^). Then we need 
to prove that any Fonrier coefficient of associated with this partition is zero. As 

explained in [8] at the beginning of the proof of Proposition 5.3, it is enongh to prove that 
nonzero Fonrier coefficients associated with the partitions for all 

m > an. 

The proof of this statement abont the Fonrier coefficients is similar to nm- In [S] this 
was proved by local means, and this was replaced in [10] by a version of Proposition [T] 
To indicate the approach, snppose that m is even. The case that m is odd is similar and 
will be omitted. If m is even, then the Fonrier coefficient associated with the nnipotent 
orbit is given as follows. Let Pm denote the parabolic snbgronp of GLabn whose 

Levi part is GLf" x GLabn-m- We embed the Levi part in GLabn as all matrices of the 
form diag(ai,..., am/ 2 , h, 6i,..., bm/ 2 ), with a*, h G GLi, h e GLabn-m- Let denote the 
nnipotent radical of Pm, and Vm denote the snbgronp of which consists of all matrices 
V = {vij) snch that Vi^abn-!f+i = 0 for all Y +1 < z < abn — y- Let denote the character 
of Vm defined as follows. For v = (vij) G Vm set 

m/2-1 

,abn-f+1 + ^ (W*+l + W6n,-f+i,abn-f+j+l)y 

i=l 

Then, the Fonrier coefficient corresponding to the partition is given by 

J E^bi,x(^)i^vjv)dv. 

Vm(F)\Vm(A) 

Let wi denote the Weyl element of GLabn defined by 


Wi = 


^abn—m 


Conjngating by Wi and performing some Fonrier expansions, one dednces that the vanishing 
of the above integral for all choices of data is eqnivalent to the vanishing of 


(4) 


E!ai^n,x(^) i’Umiu) du 


Um(F)\Um{A) 


for all choices of data. Here Um is the nnipotent radical of the standard parabolic snbgronp 
of GLabn whose Levi part is GL'f^~^ x GLabn-m+i, with the Levi part embedded in GLabn 
as diag(ai,..., 0 ^- 1 , h) (oj G GLi, 1 < z < m — 1, and h G GLahn-m+i), and is the 
character 

i’Umi'E) = V’(Wl ,2 + M2.3 H-K Mm-l,m)- 

Note that when m = abn, the gronp Uabn is the maximal npper triangnlar nnipotent snbgronp 
of GLabn- 


Let a = {oii)m<i<ahn-i witli Qfj G {0,1} for all i and define 

m—1 abn—1 

'4)U^,a{u) ='lp{^'^Ui,i+l+ ^ 

2=1 i=m 

Then performing Fourier expansions, one sees that the vanishing of the integral (jl]) is equiv¬ 
alent to the vanishing of all the integrals 

(5) j 

Uabn{F)\Uabr,{A) 

If ttj = 1 for all i, then the integral ([5]) is the Whittaker coefficient of ^ which is zero. 
If instead a, = 0 for some i, let k > mhe the hrst integer such that a* = 1 for all m < i < fc 
and afc+i = 0. li k ^ np for some natural number p, then the corresponding integral ([S]) is 
zero. Indeed, since Qn}x is a cuspidal representation, the constant term s) is zero if 

U is not equal to U(^ab-i)n,in for some /. (Note that it is precisely at this point in the argument 
that we use the cuspidality hypothesis.) On the other hand, ii k = np, then it follows from 
Proposition [U that integral ([5]) is zero if the residue representation Snp,x is not generic. But 

fr) 

since np = k > m > an, it follows from the definition of a that £np,x is indeed not generic. 
This completes the proof that ^ has no nonzero Fourier coefficient corresponding to any 
unipotent orbit which greater than or not related to ((an)^). 

The last step is to prove that ^ has a nonzero Fourier coefficient corresponding to 
the partition ((an)^). This is proved similarly to [8] pp. 338-339; see also [lO] and [I3]. Let 
^abnx ^ vector in the space of S^^bux' Then it follows from [8], p. 338, that the Fourier 
coefficient of with respect to the orbit ((an)^) is given by the integral 

( 6 ) f{h)= j E^^^^{vh)i;v{v)dv. 

V{F)\V(A) 

Here we let the I4_p be the unipotent subgroup of GL^p consisting of all matrices of the from 


(7) 


/h Xi,2 * * ■■■ *\ 

Ik X2,3 * • • • * 

Ik -^ 3,4 • ■ • * 

Ik ■ ■■ * 

* 

V ikj 


with Ik appearing p times and each Xjj a matrix of size k. The group V in the integral 
([ 6 ]) is the group I 4 ^p with k = b and p = an. Also, define a character 'ijJVkp ^k,p by 

= 'ip{tT{Xi^2 + X2,3 H-h Xp_i,p)). Then the character ipv in (E]) is V’Vb,a„- 

Let Uan denote the maximal upper unipotent subgroup of GLan, and let U' = Uan x • • • x Uan 
where the group Uan appears b times. This group is embedded in GLanb as (mi, ... ,Ub) i—)■ 
diag(Mi,..., Ub). Let xjju' be the character given by 
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where 'ijJUan is the standard Whittaker character of Uan- Then as in [8] p. 338, the integral 
(1^ is nonzero for some choice of data if and only if the integral 

( 8 ) j j E^2n,^{vu')'ilJu'{u')dvdu' 

U'{F)\U'{K) Vb,an{F)\Vb,ar^W 

is not zero for some choice of data. Using ([3]) indnctively and the irredncibility of the 
representation 8an,xi we dednce that the integral ([8]) is not zero for some choice of data if 
the representation £an,x is generic. This last assertion follows from onr assnmption on the 
nnmber a. □ 

We can now prove the hrst part of Theorem [T] 

Proposition 3. Let n < r be a natural number, and suppose there exists a cuspidal theta 
representation Qn}x on GLn\A). Then n divides r. 

Proof. Snppose instead that n does not divide r. Constrnct the representation ^ on the 
gronp above. It follows from Proposition [2] that = {{an)^). Let 

be a vector in the space of Then the Fonrier coefficient of with respect to the 

orbit {{an)^) is given by the integral (jb]) above. 

Since an < r and b > 2, the Fonrier coefficient (jb]) defines a gennine antomorphic fnnction 
on some covering gronp of GLb{A) of degree greater than one. Hence f{h) cannot be the 
constant fnnction. Note that at this step we are nsing the hypothesis that n does not divide 
r. Indeed, this assnmption implies that an ^ r. By contrast, if an = r, then it might happen 
that the above embedding of the gronp GLb splits nnder the r-fold cover, and we would not 
be able to assert that f{h) is not constant. 

Let a denote the representation generated by all functions f{h) as above. Since a non¬ 
constant antomorphic function cannot equal a constant term along any unipotent subgroup, 
it follows that the integral 

(9) / f{x(l))'ilj(l)dl where x(/) = Jb-|-/ei^b 

F\A 

is not zero for some function / in cr (here and below Cij denotes the (i,j)-th elementary 
matrix). Using this nonvanishing, we will show that the representation has a nonzero 

Fourier coefficient corresponding to the unipotent orbit ((an -|- l)(an)^“^(an — 1)). 

To do so, we introduce two families of unipotent subgroups of GLabn- First, let Zi, 1 < 
i < an — 1, denote the unipotent subgroup with 

Zi{k) = {riCfe,! + r 20^,2 H-h rb_ieb,b_i : G A} C 

and let Zq denote the group with 

Zq{A) = {r 262,1 + ^363,1 - 1 - • ■ ■ -f- rb_iefe_i,i : rj G A} C Wi,2. 

Here each is embedded in GLabn as in ([7]). Notice that Zq and Zi are two distinct 

subgroups of Xi 2 . Second, for 1 < i < an — 1 let 

Ti(A) = {If, + hei^b + ^2^2,6 + • • ■ + 
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Ij G A} 


and let 


^o('^) — {h + hGi,2 + h^i,3 + • • • + Ib-iGifi-i : Ij G A} 

These groups are embedded in GLabn as diag(Fo) • • • > ^an-i)- Also, let Z be the unipotent 
subgroup of GLabn generated by all Z, with 0 < i < an — 1, and let Y be the unipotent 
subgroup of GLabn generated by the Yi, 0 < i < an — 1, together with the one dimensional 
unipotent subgroup x{l) dehned in ([2]). 

Substituting ([9]) into ([6]) we then expand the integral along the unipotent subgroups Yi 
where 0 < i < an — 1. Then using the unipotent subgroups Xi, we obtain that the integral 
([9]) is equal to 

(10) j j E^^^Jvizh)'ipvAvi)dvidz, 

Z(K) Vi(F)\Vi(A) 

where Vi is the subgroup of V generated by Y and all the one-parameter unipotent subgroups 
{xa(t)}, a a positive root, that are in V but not in Z. The character matches xfjy on 
the one-parameter subgroups {xa(t)} in V that are not in Z and is 'ipiyifi) on y(A). 

To conclude the proof, we note that the inner integration over Vi in fllUl) is a Fourier 
coefficient corresponding to the unipotent orbit ((an -|- l)(an)^“^(an — 1)). Since it is not 
zero this contradicts Proposition [2l □ 


4. The Uniqueness Property 


In this section we prove the uniqueness property given in Theorem [TJ To do so, suppose 
that there are two natural numbers, n and m, m < n, with cuspidal theta representations 
and attached to the same character y. We shall derive a contradiction. 

As above, let a > 1 be the smallest natural number such that Sin^x irreducible generic 
representation. From Section [3] we know that n divides r, and hence, using m, we have 
an < r. Choose the smallest integer b > 1 such that abn + m > r. Construct the residue 
representation ^ as in Section [2l This representation is the residue of the Eisenstein 

series on GL^’)^_^^(A) attached to the induced representation 


Ind 


GL, 

P, 


(r) c 

nZ + m ' 
(r) 



Denote by transpose of the unipotent group Un,...,n,m, dehned in Section [21 

The following Lemma is standard. 


Lemma 2. Let U denote the unipotent radical of a maximal parabolic subgroup of GLabn+m- 
If there is no Weyl element w in GLabn+m such that wUw~^ is a subgroup of Lf~ ,a „i, then 

the constant term is zero for all choices of data. 

With this we have the following analogue of Proposition [H 


Proposition 4. Let U denote the unipotent radical of the maximal parabolic subgroup of 
GLabn+m whosc Lcvi part is GL^^ x GLr^ with ri = m + kn and r 2 = {ab — k)n for some 

/c > 0. Suppose that wUw~^ is a subgroup ofU~ .a,m some Weyl element w. Let ^ 

ii’ ’ ’ 


be a vector in the space of Then for z = 1,2 there exist i'o the space of Sif^x 

such that 

e'IL., ((”' „^)) = 

for all unipotents Vi G GLr^{E). Moreover a statement similar to Proposition{I\ part (ii), 
holds in this case as well. 


With these properties we can prove 

Proposition 5. Under the hypotheses of this section, ~ {{an)^m). 

Proof. There are two things to establish. The hrst is the vanishing property of the Fourier 
coefficients with respect to orbits that are greater than or incomparable with ((an)^m). This 
vanishing is established similarly to the proof of Proposition [2] above. We omit the details. 

The second part of the assertion is the nonvanishing of a Fourier coefficient attached to 
the partition ((an)^m). We now describe such a coefficient. The description depends on the 
parity relation between an and m. We shall give the details in the case where both numbers 
are odd. The other cases are similar. 

Let V denote the unipotent subgroup of GLabn+m consisting of all matrices of the form 


Vi Vi Ue 
V2 V5 


Vi,Vs e Vf,,(an-m)/ 2 , ^2 G W+l.r 


Here the groups 14,p were dehned in ([7]) above, and Vi,V 5 ,VG are general suitably-sized ma- 

* * 


trices. Write ^ 4=1 , 

* 

* *' 


where ^4 G Mat^xb, and let '01(^4) = v'^). Similarly, write 


^5 = I ^5 * with v'^ G Matfoxb and v'f G Matixb, and let '^ 2 (^ 5 ) = '0(tr v'^). Let fjy be the 


.v'l *, 


character 

^v{v) = V’y6.(..-^)/2(^3) Mva) ^ 2 (^ 5 ). 

Then a Fourier coefficient associated with the partition {{an)^m) is given by 

j E^Ibi+m,x(^h)f;v{v)dv. 

ViF)\V{A) 

Let z/i be the Weyl element of GLabn+m dehned as follows. Write 


( 11 ) 


= 


/Wo\ 

Wi 

\wbj 


Wq G Mat^x (anfe+m) 5 ^ ^at^^x (anb+m) 5 1 4 J 4 


Here the matrix wq has (z, b{i +1)) entries equal to 1 , 1 < z < m, and all other entries 0, 
where t = {an — m)/2. The matrices Wj, 1 < j < &, have entries of 1 at the {ii,j -|- (4 — 
1 ) 6 ), {t -|- Z 2 , j + t 6 -|- 4(6 + 1 )) and {t + m + i^ + 1, j + tb + m{h + 1 ) + i^h) positions for all 
1 < ii <t + l, 1 < i 2 < rn and 1 < is < t — 1, and all other entries 0. This Weyl element may 
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be characterized as follows. As explained in [8], to any unipotent orbit O one can attach a 
one dimensional torus {ho{t)}. In our case, for the unipotent orbit O = {{an)^m), 


ho{t) = diag , r+'A, r-'A+i,..., A,..., A). 


The Weyl element vi is the shortest Weyl element in GLabn+m which conjugates the torus 
{ho{t)} to the torus {h{t)} with h{t) = diag{dm(t), dan(t),..., dan(t)), where for alH > 0 we 
have di{t) = diag{f-\ fh-b). 

Using the invariance of ^ by ui and moving it rightward via conjugation, the integral 

m is equal to 

(12) III ^abn+m,x^y^'^^^^)^u'{u')dydu'dz. 

Z{F)\Z{A) U'{F)\U'{A) Y{F)\Y{A) 

The notation here is as follows. Let Uk denote the maximal unipotent subgroup of GLk 
consisting of upper triangular matrices. Then U' = Um x Uan x • • • x Uan where the 
group Uan appears h times. This group is embedded inside GLanb+m as (mo,Mi, ... ,Ub) 
diag(Mo, Ml,..., Ub). The character is given by 

'Ipwiu') = 'lpUmiUo)'4’UaAUl) . ..^l^UaAUb), 

where is the standard Whittaker character of Uk- The group Y is the upper triangular 
unipotent group dehned by U = fl Um,an,...,an- The group Z is the lower triangular 

unipotent group consisting of all elements v E V such that z/iMz/f ^ e U~ an an where 
the group „„ is the transpose of the unipotent group Um,an,...,an- Another way of 

characterizing these groups is by means of the torus {h(t)}. The group Y is generated by the 
matrices yi,j{k) = Ubn+m + kcij e Um,an,...,an such that h(t)yij{k)h(t)~^ = yi,j(t^k) for some 
£ > 0. Similarly, the group Z is generated by all matrices Zij{k) = labn+mYketj G 
such that h{t)zij{k)h{t)~^ = Zij{t^k) for some i > 0. 

The next step is to perform certain Fourier expansions on the integral 0121) . using root 
exchange and the vanishing of the Fourier coefficients of the representation ^ corre¬ 

sponding to unipotent orbits which are greater than or not comparable to {{an)’^m). This 
process is fairly standard - see for example the proof of Ginzburg-Rallis-Soudry [H] , Lemma 
2.4 - and so we only sketch the ideas. View Uni,an,...,an as the group of matrices generated 
by Uij{k) = labn+m + kcij. Similarly for the groups Y and Z. Consider the subgroup 

'^an+m—l,abn+nfi{k^ ■ Siuce h(t')Uan+m—l,abn+mi^k')h(t') Uan+m,— l,abn+mi^k') ^ this OUe dimeU- 

sional unipotent group is not in Y. Similarly, conjugating by h(t) we deduce that Ui^abn+m{k) 
is in V for all 1 < i < an -|- m — 2, and that Zabn+m-i,an+m-iik) is in Z. We may continue 
this process, going from the last to the hrst column in Um,an,...,an- When we encounter a 
unipotent group of the form Uij{k) in Um,an,...,an which is not in Y we look for a suitable 
unipotent subgroup of Z. If such a subgroup exists, we perform a root exchange. If not, we 
check that the Fourier coefficient obtained corresponds to a unipotent orbit which is greater 
than or not related to {{an)^m). This implies that all non-trivial characters of the expansion 
contribute zero, and we are left with only the trivial character. 
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By this argument, we see that integral (fTTj) is not zero for some choice of data if and only 
if the integral 

(13) J j E^;^^^^.^{uu'h)^l)u'{u')dudu' 

U'{F)\U'iA) Um ,an,... ,an {F)\Um ,an,.. .,an (■^) 

is not zero for some choice of data. 

Notice that Um,abn is a subgroup of Um,an,...,an, and it is the unipotent radical of the maximal 
parabolic subgroup Pm,abn- Hence we can apply inductively Proposition 0] with to deduce 
that the integral flT^ is not zero for some choice of data if the two integrals 

(14) J ^/JuM du 

Um{F)\UmiA) 

and 

(15) J E]^l^{u)i)UaSu)du 

Uah,^{F)\Uabr.W 

are each nonzero for suitable data. The integral flTT)) is not zero since Qm]x is an irreducible 

('T') 

cuspidal representation, and hence generic. It follows from the irreducibility of San,x and 
from the dehnition of a, that the second integral, 03 . is also nonzero for some choice of 
data. □ 


With the above we can now prove 


Proposition 6. Fix r and x- Then there is at most one natural number n such that a 
cuspidal theta representation On,x exists. 


Proof. Recall that we are supposing that m < n and there exist cuspidal theta representations 
Qnlc and Qm,x- We will derive a contradiction. Form the residue representation ^ as 

above. Then the integral ffTTj) is not zero for some choice of data. We claim that this implies 
that the integral 

(16) J J E^J^^^^^{uu'h)fju'{u')dudu' 

U'iF)\U'iA) Uan,...,au,m{F)\Uau,...,anM^) 

is not zero for some choice of data. Notice the difference between the integrals (fT6|) and 
([I3]). In ([T3D the integration is over Um,an,...,an{P)\Um,an,...,an{^), while in ([16]) it is over 
Uan,...,an,m{P)\Uan,...,an,m{^)- These are two different groups. 

To prove that the integral flTHl) is not zero for some choice of data, we start with the 
integral (ITT]) , which we have already shown is nonzero for some choice of data. Let z /2 be the 
Weyl element 


/Wi\ 


F2 


Wb 

\woJ 


Wq G Matjn X (anb+m)) ^ anx (anb+m)) ^ — j — b.. 
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where the matrices Wi are as above. Inserting z /2 into ffTTj) and performing similar Fourier 
expansions, we deduce that the integral (1T6|) is not zero for some choice of data. Here 
U' = Uan X • • • X Uan X t/m, and the character 'ipu' is defined accordingly. But notice that 
Uabn,m IS a subgroup of Uan,...,an,m which is also the unipotent radical of a maximal parabolic 
subgroup. However, there is no Weyl element w such that wUabn,mW~^ is contained in 
U~ nm- Hence, by Lemma [2] we obtain that the integral (1TB]) is zero for all choices of data. 
This is a contradiction. □ 


5. The Condition on the Character y 

Suppose that is a cuspidal theta representation and x = Xi for some character xi- 
We shall derive a contradiction. The idea is similar to the one we used in Section HI 

First, by Flicker [B], we know that Theorem [T] holds if n = 2. Let n > 3. Similarly to |llj . 
we may construct the theta representation © 2 *^^ by means of a residue of an Eisenstein series. 
This is possible since x = X\- This representation has a nonzero constant term and so is 
not cuspidal. Dehne a and b as in Section H] above and let m dehned in that section equal 2 
in the present case. Then construct the residue representation Sa^i+m x ~ ^a '^+2 x ^-bove. 

Although the representation © 2 ^^ is not cuspidal, most of the results stated in Section H] go 
through with small adaptations. In particular, we have 

Proposition 7. Under the hypotheses of this section, = ((an)^2). 

Then we obtain a contradiction as in Section |H Indeed, from Proposition [7] we obtain that 
the Fourier coefficient 

' 4 ’u'{u') du du' 

U'{F)\U'{A) 

Uan,... ,0,71,2 (E)Wan,... ,071,2 (■^) 

is not zero for some choice of data. Notice that Uabn,2 is a subgroup of Uan,...,an,2- However, 
even though © 2 ’^^ is not cuspidal, the constant term of x Uabn,2 is still zero for all 

choices of data. Indeed, it is not hard to check that there is no Weyl element w in GLabn+2 
such that wUabn,2W~^ is contained in ^,^ 2 - The vanishing of this constant term then 

follows as in Lemma [2J However, this is a contradiction, and the result follows. 
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